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ABSTRACT 

This paper examines how Team Learning allows students to express themselves through their 
work. I define expression to include taking ownership of one’s work, i.e. working through self- 
motivation rather than through the dictates of a teacher, and participating in a community of 
workers. This participation includes working with colleagues on projects of interest to the 
community, submitting one’s work to the scrutiny of the team and the larger community, and 
evaluating colleagues ’ work in the same manner. I present the results of my use of Team Learning 
in four computer programming classes. 
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INTRODUCTION 



he lecture remains a common delivery method on university campuses today [18]. 
complaint about the lecture method is the passive role that many students adopt [15]. 
lecture classes rarely ask questions or stop the instructor to ask for clarification [10]. 


A frequent 
Students in 


After many years of lecturing, I turned to Team Learning, also called active learning or collaborative 
learning, as a way to motivate students to participate more in class and to take greater ownership of their work. This 
paper reports the results of my efforts in teaching computer programming using the team learning approach 
developed by Michaelsen and Black [17]. 

Team Learning depends upon the idea that students, working in small groups on a professional-level 
problem, can teach themselves and each other the material of a course or unit. The instructor of such a unit shifts 
his/her role from information dispenser to course designer and classroom manager. Team Learning is “one of the 
most thoroughly researched of all instructional methods [21]." According to Johnson, Johnson and Smith: 

During the past 90 years more than 600 studies have been conducted by a wide variety of researchers in different 
decades with different age subjects, in different subject areas and in different environments. We know far more 
about the efficacy of cooperative learning than we know about lecturing, departmentalization, the use of 
instructional technology or almost any other facet of education. 


Table 1 - Research on the Effectiveness of Team Learning 


Findings 

Authors 

More effective for promoting student higher-level thinking skills than lecture. 

Kulik and Kulik [14] 

Smith [22, 23] 

McKeachie [16] 

More effective for promoting student learning and achievement than traditional instructional 
methods. 

Johnson et al. [13] 

Slavin [21] 

Dansereau [5] 

More effective in increasing student retention than traditional learning methods. 

Tinto [24] 

Astin [1] 

Wales & Saeger [26] 

Treisman [25] 

| Reference: Adapted from Cooper, et al. [4], | 
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Table 1 summarizes the key findings of the research on the effectiveness of team learning as I believe they 
relate to technical courses [3], 

The phrase higher-level thinking used in Table 1 refers to Bloom’s Taxonomy of Cognitive Levels [2], 
Table 2 lists the levels of the Bloom model along with parallel student activities [8]. 


Table 2 - Bloom’s Taxonomy of Cognitive Levels 


Cognitive Level 

Student Activity 

Evaluation 

Synthesis 

Analysis 

Application 

Comprehension 

Knowledge 

Making a judgment based on a pre-established set of criteria 

Producing something new or original from component parts. 

Breaking material down into its component parts to see interrelationships. 

Using a concept to solve a problem. 

Explaining/interpreting the meaning of material. 

Remembering facts, terms, concepts, definitions, principles. 

| Reference: Duch and Allen [8], j 


TEAM LEARNING IN TECHNICAL COURSES 

Team Learning, as adapted in this paper, has as its first goal to put the design of a computer programming 
unit on a foundation of objectives expressed in terms of the Bloom taxonomy. The key design question is "What do 
I want the students to be able to do when they finish this unit?" In addition, I strove to maximize active practice that 
engages students at the levels of the Bloom taxonomy appropriate for the objectives. 

The key attributes of our class were 1) the instructor designs the unit to fulfill objectives expressed in terms 
of the Bloom taxonomy, 2) the instructor develops problems to support the objectives, 3) students teach themselves 
by working in groups on the problems, 4) on a day-to-day basis, the instructor manages the classroom work 
environment instead of acting as the source of all knowledge and activity. 

For example, consider the SQL WHERE clause. This is usually taught immediately after students learn to 
specify a single table in a FROM clause [6]. Low-level objectives might include the syntax of the clause and the 
operators and functions commonly used in the clause. Mid-level objectives could include understanding the role of 
the clause as a qualifier of rows, debugging syntax errors and using vendor documentation, while high-level 
objectives might deal with debugging logic errors, the kinds of problems that the clause can and cannot solve and 
what to do when faced with an unsolvable problem. 

We learned the WHERE clause through the following problem posed to the student groups after they had 
read the text on the WHERE clause and taken a readiness assessment quiz (Readiness Assessment is discussed later 
in this paper). 

A university database contains a table named COURSE that contains the id and title of all courses offered by the 
institution. A person calls the registrar asking, "What courses on Unix do you offer?" How does the registrar 
answer the question ? 

The facetious, but sensible answer, to transfer the caller to the chair of the IS department came up early, 
and I allocated time to allow students to discuss this option. It was worth spending some time, since the solution the 
database eventually provides was not satisfactory to the caller. 

Once students began thinking about a query, they eventually settled on the idea of scanning the title column 
for the string 'Unix.' In arriving at this strategy, they examined the role of the WHERE clause and the functions and 
operators used in the clause. Getting the clause to work taught syntax and the debugging of syntax errors. 
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The COURSE table contained titles such as “Introduction to Unix” and “Unix Administration,” which were 
returned by the query most students developed. The table also contained a title such as “Korn Shell Scripting,” 
which was not returned. The ensuing discussion eventually brought groups to decide that the database, as it is 
designed currently, cannot do an accurate job of answering the caller's question [20]. Suggestions of expanding the 
table to include a keywords column gave additional insights into the role of the WHERE clause and the choices 
among operators and functions that are involved it its use. Groups also questioned whether the scenario was 
important enough to merit a change in the design of the database. The final deliverable of the activity was a 
decision on this question accompanied by a written analysis. 

I hoped that including Team Learning in this course would engage students more actively and at a higher 
level of thinking. Activities were designed so that working at this higher level affected the quality of the work at the 
lower levels as well. A second purpose of the problem assignment was to get students to take ownership of their 
learning. Teaching IS students how to teach themselves a new technology, while facing a deliverable deadline, may 
be the most important thing we do in the classroom. 

I also hoped to improve retention. In the WHERE clause problem mentioned above, the titles in the 
database were all caps, so scanning for the string "Unix" gives "no rows returned," the most instructive error 
message in the SQL environment. Once students applied functions to the WHERE clause to address this problem, I 
hoped they would remember to use these functions throughout the rest of the semester. This turned out to be the 
case, so the trading of lecture time for group work on a realistic problem increased the opportunity for these 
instructive "errors" to occur. 

THE INSTRUCTIONAL ACTIVITY SEQUENCE 

Michaelsen and Black present a framework for unit design called the Instructional Activity Sequence [17]. 
The sequence begins with the desired educational outcomes. What does the instructor want students to be able to do 
when they have completed this unit of instruction? Bloom's taxonomy serves as a guide for choosing objectives and 
for deciding at what level the instructor wants to engage the students during this unit. These decisions affect the 
choice of application-oriented activities presented later in the sequence. 

Once the desired educational outcomes are identified, the instructor specifies the course content that 
students must know before beginning to work on the unit in class. In a technical class, this course content could 
include readings from the text on the new material and exercises dealing with the material that led up to the current 
unit. 

Readiness Assurance Process 

The in-class activity on a new unit begins with what Michaelsen calls the Readiness Assurance Process. 
The purpose of Readiness Assurance is to determine what students have already learned on their own or from each 
other so that group work can build from that point. Readiness Assurance begins with a short quiz taken by students 
individually. Short answer and multiple choice questions are favored because they allow quick grading turnaround. 
The individual quiz ensures individual accountability and serves as a diagnostic tool for the instructor in planning 
later activities. 

After the individual quiz is taken, but before it is graded and returned, students work on the same set of 
questions in their groups. During group tests, students exchange information with their peers. In the roles of teacher 
and learner, a student's understanding of course concepts is broadened. Both types of quizzes count toward a 
student's final grade. The weighting is up to the individual instructor. 

After the individual and group quizzes, solutions or a list of key points that should have been covered 
should be distributed and discussed in class. During this feedback session, the instructor should be evaluating how 
well the students know the course content that the instructor identified as necessary to meet the desired educational 
outcomes. At this point, the instructor can also present any related material that may not have been covered in the 
readings. 
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A final feature of the Readiness Assurance Process is the Written Group Appeal. Appeals are an effective 
way to increase both learning and group cohesiveness. If a group feels that their answer to a question should receive 
credit, even though it differs from the instructor's answer, then the group should prepare a written appeal stating the 
question involved, their preferred correct answer, the basis for their appeal and the evidence that supports their point 
of view. When an appeal is granted, Michaelsen recommends giving the appropriate number of points to both the 
group and each individual in that group, but not members of other groups. 

Individual and group quizzes, written group appeals and instructor feedback comprise the Readiness 
Assurance Process and lead to the Application-Oriented Activities. Students and instructor have confidence that the 
concepts necessary for the desired educational outcomes are understood, and students are ready to apply these 
concepts to concrete problems. 

Application-Oriented Activities 

Designing application-oriented activities that support learning objectives is challenging, but there is 
extensive research [1, 7, 8, 9, 11, 19] to support the instructor developing his/her first team learning unit. Common 
recommendations include: 

• Must require the groups to produce a tangible output. 

• Should give students the opportunity to practice dealing with the same kinds of issues and situations 
they will encounter in future jobs 

• Must be impossible to complete unless students understand course concepts. 

• Should allow groups to spend the majority of their time doing what groups do well, e.g., identifying 
problems, formulating strategies, making decisions. 

• Must be difficult enough so that very few students can complete the assignment working alone. 

Student Evaluation 

The Team Learning instructor has individual quizzes, group quizzes, group activity deliverables and peer 
evaluations to use in the construction of a final grade for the unit for each student. The weights assigned to each 
type of grade should reflect the instructor's preferences along with his/her assessment of the students' independence, 
honesty and experience with team projects. Since I did not use Team Learning for the whole course, I included 
individual mid-term and final exams in the course requirements. 

EXPERIENCES & OBSERVATIONS 

My use of Team Learning began slowly. Over time, I built my collection of activities and my experience 
with classroom management. As of this writing, four programming classes have used Michaelsen's Instructional 
Activity Sequence as a regular mode of class operation. 

I found it necessary to adhere carefully to the Instructional Activity Sequence to keep the unit moving 
forward. I spent about one third of class time on Readiness Assurance and two thirds on Application-Oriented 
Activities. On average, students spent about one hour on out-of-class work for every hour of in-class work, and they 
reported a strong need to attend all classes. 

Research [12] suggests that instructor-formed groups are preferable to groups chosen by the students 
themselves. I agree, even though students argue that getting together will be easier if they are teamed with someone 
with whom they work or who lives in their dorm. Part of the first unit must be devoted to team building [3], We 
used a team contract: a list of norms, developed by each group that articulates the performance and behavior 
expectations. Most conflicts that arose later in the term were caused by someone or everyone breaking the team 
contract. Conflict resolution was easier in the face of a signed statement declaring the behavior in question to be 
unacceptable. 
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Although it is inconvenient for announcements and instructor feedback, I believe it is necessary to hold the 
class in a room equipped with a computer for each student. Laptops and wireless Internet access comprise an ideal 
platform; desktop workstations at fixed locations run a distant second. That being said, I often asked students to 
leave the keyboard to think or to discuss a pertinent issue or to make certain of the course of action before writing 
code. 


Students perceived that they worked harder on these units than on others, so motivation was always on my 
mind. I tried to make the demands of the entry-level job market as real as possible. Several times during the 
semester, I reviewed sample questions from various professional certification examinations, and we discussed 
technical job interviews often. I found it helpful to let students who had been "teched out" in applying for a job 
interview other students in the presence of the entire class. This knowledge of the market helped students to see the 
workload as a reasonable means to the end they desired. These exercises also gave the students a chance to practice 
articulating ideas and solutions related to the technical content. 

Advantages of Team Learning 

In the units in which Team Learning was used. I've seen the best student work ever, and I've had the best 
student-teacher and student-student interactions ever. Students asked deep questions. Since they were working on a 
significant problem, their questions were focused and highly motivated. More work was done, and the classroom 
was more energetic and professional. 

Initially, I feared spending time on higher level issues, such as evaluating a request to change our data 
model, in a programming class. I believed that the students' knowledge of programming objects and structures 
would suffer. Those fears were unfounded. Questions at the higher levels force the lower level work to get done. I 
believe the Readiness Assurance Process is responsible for this. This is a solid, workable methodology that does not 
let the lower level material slip away, despite the fact that it spends quite a bit of time at the higher levels of the 
Bloom taxonomy. 

Individual student achievement, as measured by individual quiz grades, was about the same; certainly no 
worse than lecture-only units. I am motivated to continue because the students were able to complete more work, 
gain a broader range of experience, and acquire new skills such as verbal articulation of ideas and develop new 
attitudes toward ownership of work without sacrificing performance on traditional evaluation tasks. 

Also, there seems to be no upper limit on what the best students can do in a Team Learning unit. The 
opportunity to be actively engaged so often during the unit provides the means for these students to exercise their 
gifts at a very high level. Their response, in turn, energizes the group, and provides an atmosphere of 
professionalism in the class. 

Disadvantages of Team Learning 

Developing objectives, quizzes and activities takes a lot of time, more time than preparing lectures. There 
is also a lot of grading to do, although less than expected because a large part of the grading is group submissions 
rather than individual work. The quick turnaround can also be difficult. 

Managing the groups demands diligence, resourcefulness and experience on the part of the instructor. I did 
not have much experience with groups when I began using Team Learning. I read the literature, but more 
importantly, I talked with faculty colleagues who did have the experience. They provided valuable assistance. 

The most difficult problem to address involves the groups in which one good student is doing most, if not 
all, of the work on the activities. I believe early detection is the best defense. Diligent follow-up in the form of 
observation and questioning of each student in the group by the instructor can put the group back on track. This 
extra attention does not have to be punitive. Most students want to do well, so a straightforward statement of the 
perceived problem and desired outcome creates a workable context for the students' response. This is a crucial 
point. If instructor feedback is punitive, then many students quickly surrender ownership of the work, and fall back 
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into submission to the dictates of the instructor. Feedback from the instructor must be given in terms of the 
student’s stated objectives and a shared evaluation of the likelihood of success given the current situation. 

Another issue to consider is how many Team Learning units to include in a course. Many authors say they 
use Team Learning exclusively. I prefer to cover a small number of units, say 3-5, through Team Learning, and 
use traditional means for the rest of the course. Team Learning makes students work hard in new ways. They feel 
the strain. A few units are enough to introduce the methodology and provide some tangible experience. A full 
course of these activities would, in my opinion, be overwhelming. 

One of the principles of Team Learning is that good students benefit from teaching poorer students. I 
believe this to be true because many teachers learn something new every time they teach any course, but some good 
students complained that working with poorer students prevented them from getting all they could out of the course. 
I found the complaint to be valid if the difference in ability was great. I try to counteract the problem by limiting the 
difference between the best and worst students in each group. 

This choice is not perfect. It addresses the complaint, but it sets up a caste system which students easily 
uncover. On the positive side, some weak students find the new environment to be just what they need to thrive. On 
several occasions, students with low grade point averages did the best Application-Oriented Activities in the class. 

CONCLUSION 

I feel the new atmosphere of my Team Learning units is worth the effort to develop such a delivery. 
Students took ownership of their work. As a result, they were more actively engaged and more articulate about their 
Application-Oriented Activities. The improved work, the more sophisticated work, and most importantly, the 
improved and more frequent interactions with all members of our learning community leads me to conclude that 
including some Team Learning is preferable to a lecture-only format in terms of preparation for the connected, 
global workplace and in terms of each student fulfilling his/her potential. 

AUTHOR INFORMATION 

Bill Amadio is an award-winning teacher, author and consultant with over 35 years experience in the IT industry. 
He earned a Ph.D. in mathematics in 1975 from the Polytechnic Institute of Brooklyn in New York City. He is 
currently Associate Professor of Computer Information Systems and Director of the Center for Business Forensics at 
Rider University in Lawrenceville, NJ. A data mining specialist, he is the inventor of The Exploration Engine, an 
advanced search technology designed for litigation support and business intelligence. In the classroom. Dr. Amadio 
practices problem-based learning which emphasizes hands-on exercises and student-student interactions. 

REFERENCES 

[1] Astin, A. Achieving Educational Excellence , San Francisco: Jossey-Bass, 1985. 

121 Bloom, B.S. Taxonomy of Educational Objectives: The Classification of Educational Goals, New York: 

David McKay, 1956. 

[3] Cooper, J. and R. Mueck. Student Involvement in Learning: Cooperative Learning and College Instruction. 
Journal on Excellence in College Teaching, 1 (1990), 68-76. 

[4] Cooper, J., S. Prescott, L. Cook, L. Smith, R. Mueck and J. Cuseo. Cooperative Learning and College 
Instruction: Effective Use of Student Learning Teams. Long Beach, CA: The California State University 
Foundation, 1990. 

[5] Dansereau, D. Cooperative Learning: Impact on Acquisition of Knowledge and Skills. Abilene, TX: U.S. 
Army Research Institute for the Behavioral and Social Sciences, 1983. 

[6] Deitel, H., P. Deitel and T. Nieto. e-Business & e-Commerce - How To Program. Upper Saddle River, NJ: 
Prentice Hall2001. 

[7] Delisle, R. How To Use Problem-Based Learning in the Classroom. Association for Supervision and 
Curriculum Development, 1997. 

[8] Duch, B. and D. Allen. Problems: A Key Factor in PBL. About Teaching, 50 (Spring, 1996), 25-28. 


12 



American Journal of Business Education - August 2009 


Volume 2, Number 5 


[9] Duch, B., S. Groh and D. Allen. The Power of Problem-Based Learning: A Practical 'How To' for 
Teaching Undergraduate Courses in Any Discipline. Sterling, VA: Stylus Publications, LLC, 2001. 

[10] Ediger, M. Learning opportunities in the higher education curriculum. College Student Journal, 35, 3 
(2001), 410. 

[11] Fellers, J.W. Teaching Teamwork: Exploring the Use of Cooperative Learning Teams in Information 
Systems Education. DATA BASE , Vol. 27, No. 2 (1996), pp. 44-60. 

[12] Fiechtner, S. and E. Davis. Why Groups Fail: A Survey of Student Experiences with Learning Groups. The 
Organizational Behavior Teaching Review, 9, 4 (1985), 58-73. 

[13] Johnson, D., R. Johnson and K. Smith. Cooperative Learning: Increasing College Faculty Productivity. 
ASHE-ERIC Higher Education Report No. 4, Washington, DC: The George Washington University, 

School of Education and Human Development, 1991. 

[14] Kulik, J. and C. Kulik. College Teaching, in Research on Teaching: Concepts, Findings and Implications, 
Berkeley, CA: McCutcheon, 1979. 

[15] Lieux, E. Comparison Study of Learning in Lecture vs. Problem-Based Format. About Teaching, 50 
(Spring, 1996), 18-19. 

[16] McKeachie, W. Teaching Thinking. NCRIPTAL Update, 2,1 (1988), 1. 

[17] Michaelsen, L. and R. Black. Building Learning Teams: The Key to Harnessing the Power of Small Groups 
in Higher Education. Collaborative Learning: A Sourcebook for Higher Education, 2, State College, PA: 
National Center for Teaching, Learning and Assessment, 1994. 

[18] Murry, J.P. & Murry, J.I. How do I lecture thee? College Teaching, 40, 3 (1992). 

[19] Paulson.D. Active and Cooperative Learning in the College Classroom. Retrieved 01/13/2006 from 

http://www.calstatela.edu/dept/chem/chem2/Active/index.htm. 

[20] Ryan, S., Bordoloi, B. and Harrison, D. Acquiring conceptual data modeling skills: The effect of 
cooperative learning and self-efficacy on learning outcomes. Database for Advances in Information 
Systems, 31,4 (Fall, 2000), 9-24. 

[21] Slavin, R.E. Research in Cooperative Learning: Consensus and Controversy. Educational Leadership, 47 4 
(1990), 52-55. 

[22] Smith, D. College Classroom Interactions and Critical Thinking. Journal of Educational Psychology, 69 
(1977), 180-190. 

[23] Smith, D. Instructions and Outcomes in an Undergraduate Setting. Annual Meeting of the American 
Educational Research Association, Boston, 1980. 

[24] Tinto, V. Dropout from Higher Education: A Theoretical Synthesis of Recent Research. Review of 
Educational Research, 45 1 (1975), 89-125. 

[25] Treisman, P. A Study of the Mathematics Performance of Black Students at the University of California, 
Berkeley. Dissertation Abstracts International, 47, 1641-A, Doctoral Dissertation, University of California, 
Berkeley, 1985. 

[26] Wales, C and R. Sager. The Guided Design Approach. Englewood Cliffs, NJ: Educational Technology 
Publications, 1983. 


13 



American Journal of Business Education - August 2009 


Volume 2, Number 5 


NOTES 


14 




